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ABSTRACT 

A developmental s pro ject in a college psychology 
course has shown that the computer can be a useful instrument for 
individualizing student learning and testing by freeing instructors 
from clerical and test generation tasks. , In successive stages, tlje 
computer was used for the batch generation of quizzes on each unit of 
the course, for on-line generation, scoring, and evaluation pf 
quizzes.. The COBOL, Coursewriter II, and FORTRAN languages were used, 
respectively, in the three phases. . Evaluation showed that from 80% to 
9 OX of the students completed all units and earned a grade of "A", as 
compared to 22% when non- individualized approaches were used with the 
instructors responsible for clerical tasks and test generation. 
Student reactions were overwhelmingly favorable, and. students were 
able to proceed at their .own individual paces. - Also, the mean number 
of attempts to complete each unit declined over successive units for 
a given student ..The cost, however, was relatively high 
(*$10-30/student/quater) . - (LB) 
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Dissatisfaction with the traditional .ethods Of presenting ""graduate psychology 
courses caused th» search for a aethod of individualizing Instruction that would, enable the 
students to have .ore personal contact with the instructional staff and to proceed through 
thT~ourse at their own rites. This need to" personalize instruction led to investigating the 
capability of *h! coJJStlr in aiding .anage.ent of the individualization of .instruction. One 
of ?h"irL- difficulties for an instructor who atte.pts to individualize^ instruction, as 
«anv of you well know, is* that of keeping up with the clerical work in .onitoring each 
stuLn?'s progress through the course.* Mithou/aaple clerical support, these 'instructors 
?inJ Ua? 572 their Lee is taken by non-instructional ^««*~^"!?"!' SThe 
r^coriina qrades. and writing prescriptions. In the course to be described, the role of the 
computer was deweloped in three. interrelated phases, any of which could be used as a model by, 
other instructors. 

rhe course under discussion is Psychology 311, Ani.al teaming, presented to *J*«" C *J 
»ind*raraduates at The Florida State University. The course content is divided into a 
sequence of „ Traditionally, between 25 and 100 students are enrolled in the course 

each auarter. The basic instructional prograi used in this course is .odeled • after one 
olsignod IV KeUeriuJ. .The goal of the instruction is to have each student successfully 
copplete, at his" own paceTsfecif ic oral and written objectives on each unit. 

The instructional staff- is organized so that for each eight students enrolled in the 
cours- there is a student .anager available for close supervision and one-to-one discussion. 
0?gani'Ua he hierarchfc.ur above the managers are the advisors, each of who. advises- no .ore 
*han siaht .anagors; The advisors are in turn supervised by the instructor of the course. 
ills hieraJcnicaf organization allows the students enrolled in the course to have an expert 
student or instructor available for aiscusslon at all tines. 

The basic procedure used for the course at all stages of developnent is as follows. The 
s^ud-nts III given a s*udy guide for the first unit on the first day of the. course. Each 
stfdy guide 'includes behavioral objectives, a brief discussion of so.e key concepts, 
supplementary inf or nation, study questions, and a list of reguired readings for -that unit. 
Students are told to read the study guide before reading any of the jatsrials for the unit . 
When a student feels he is ready to deaonstrate his competency on all of ths Jshavioral 
objectives^speeified in the unit study guide, he requests an oral' quiz with a .anager. Oral 
questions are used as a rapid way of evaluating whether or not a student is fa.iliar with a 
unit of material and are also used to give the student an opportunity- to verbalize the 
aaterial. The aanager orally quizzes the student on the relevant information of the unit and 
if "he student successfully co.pletes this oral quiz, he is then allowed to atte.pt the 
written portion of the unit evaluation. This , erltten evaluation is co. P osed_ of graph 
questions, identify-and-def ine questions that are answered in- essay for., and .ultiple -choice 
and true- false questions. If the student successfully completes the written quiz, he is then 
aiven the study guide for the next unit and progresses through the sa.e series of steps to 
satisfy the require.ents for that unit.' if the student fails to neet criterion on this 
written evaluation, he is given a re.edial prescription by the .anager. When he feels ready 
to aake another atte.pt, he requests another version of the written quiz. Bach j , i , 8 * B ** n * A* 

V) allowed six atte.pts on each, unit before talcing a coaprehensivs oral quiz with the 

„ instructor. 

* 

stest fins> ftitghrgtamUfla of flaiiiti 

The co.patez's role in ths pert on*U*at ion of iotrtetlon »t this 
of generating .uUif is forss of suit t..t«, VHss tsst itsii are teed is a co.rss is shieh 



students -are exposed to the sa.e test iteas at ^^JlJ^JSK^il 
for the slower students to have access *• JJ. - JlJ,JIgpgJ .ultiple test Corns. However, 
[1] has attested to solve this prob hi l>| "! ite! I*SS5es that can realistically be given 
this strategy limits the nu.ber flexible la? of alleviating this proble. is to use a 

to .any one class. to "J | n »t each student t«st approxiaatss a unique set of 

tTtlLT Tlltlt 5ool1rn,.rS.ris h ;en: a rSeo covering tractive, of each unit. . 

a .caputer progra. ^^J^^SSR &?l£R^°\S5 Tf U^-J 

lllllr, student na»e%nd nu.be*, \SSTS^^SSS&* iaentif y-ant-def ine, and/or graph 
q^ionsTonSheVtto. ^S'lSrta^*. 1 !^ of the question code nu.bers 
used hv the nanagar for scoring purposes. 

ror each student, the guestions o, , eacl ; oj J the six :UT%£t: 
particular unit were rando.ly selected «itkout '•'^f^fS t JJ s "e for.at and covered a 
question pools. Ill of the ^f 110 "/"^"^^^ question" pool" aigh.t consist of 
different aspect of the assignment. Tor ""P^'f^Jprecedin? unit; whereas, Another , 
ilent if y-and-defin*. questions on "View "J*! r ^J a 5||%f a P particu i ar concept .fro. t*e 
pool night consist of ■»l*iP le - ch01c * que . °" s a f e 4«nr D Ir atteant could be selected froa on* 
current unit. For eaclr unit, up to nine l^^^S^JtiSI for™ particular student on' 
question pool." The 9?*eration of a ^2115 tK qSJ-5l5- poSf This latter feature, together 
a specific unit did not necessarily f™"!* J?,:'* reolacenent, aeant that each- co.puter- 
vith the fact that questions were f Jjjj™* novates" ite.s. There was no overlap in . 

generated a,ttea P t approximated a "abination of J|JJ^J e " The , oaltlOMl _ fac t that on the 
test iteas over successive atte.pt « J« "J.^^ ^^resulted in little if any overlap in 
average students required only two atteaprs per u.m 
iteas across student atteapts. 

xn addiUon to "piaiy generating unigue atte.pts ^ 

other iteas. Finally, the fact tjjt ^^^S* 6 ;?*. TspecillcVrtering of ite.s. Figure 1 
presents^ exa. P ?e -2 ^ \£L*Sfa%««* ^ the syste.. 

This use of the co.puter in ^■"•i*?-*^^ 
generating tests was used in Psychology J"*""'^*" SSf '(MO students/quarter) since 
quarter, 1971 as well, as in an Introd ^tory Psycno logy co w » fl t0 ai8C oeer a 

• is ?r£!i2S.M^W »<• 

Stage Tt-ot * ProtgtiEt For Online SS&§Efi£iSB#" 
"lioring'ind Evaluation Of Quizzes 

». «... it., pools ;.r. »»•<•»•« ^ t r C Tco."tU-.:^ 

at the FSO Computer Center (Stage 1) , the second part, the student signed on 

true-false questions. ; <»• J *« i5Kw^I^tk?«SS2t *SS then presented test 

to a teletype connected to the 1M ^00/1800 JIJtJJ^jT J as to facilit ate test scoring and 
iteas and responded in real ti.e with his ans »-« "° stuaant was told by the 

innediate feedback. innediately after co.pleting a quiz, the "uaent was wi I 
coaputar that he had successfully aet criterion for the unit S^**"^ *J e * COttla 
aanager for prescriptive suggestions J" « stud ying pa rts of Jjj »JJ a ;° owed a mmTnm of . 
successfully co.plete "the quiz on the next criterion before being sent to a 

six atte.pts per unit to- aeet the Pr«; s P ec "J on-fiS Irocess was very helpful to both 
coaprahensire oral guis with the instructor. This on nn P r ^;" a w " a a ^coraed b y the 
instructors and student . an ager. since ^J^^VS*St5 Vv«. freed the 
computer. In Addition, the cri Jt^t", .Silwitllrf and Allowed tho» to spend »or* 



latencies", levels of state an'xiety within * the testing situation, and total test-taking 
latency were also readily available froa the CM prograa. 

The IBB 1500/1800 syst-n was designed priaarily for research and development and the 
UalteS nuaber of tereinals (eight) available to students in this, course pushed the testing 
aaterials toward a larger cpapu.ter systea. 

The Current stage: Flgxible On-line Generation, 
scoring And Evaluation gf Quizzes 

currently, "he course" is presented on "the CDC 6500 systea at the FSB Computing C«nter 
with remote teletype ter.inals situated in the Psychology .Building. * series of Progra.s (3] 
h-is h—n wriften in FOBTBAH IV to perform aany of the functions of the Coursewriter II CHI 
prograVon I co.puteJ systei not designed -specif ically for-anything but batch Processing.- 
This FOBTBAS-based MX* package acts as both a conputer-basfed .testing prograa and also as a 
I5S aaiaqlilnt systea. ^systea of direct-access- files, and i»Jl"Ct- access f^les has . been 
cr»a«-ai to hold the prograas and student reponse data when the CHI systea is in use. When 
not in operation, the files are stored on aagnetic tapes to be used as backup files in case 
of coaputer systea failure and .also to relieve the load on the peraanent file disc storage 
systea. • - ' . . 

IT»- initiating the CM package, aultiple-choice and true-false q«estions their 
associated responses, along with the several programs, are loaded into files fia Packed 
cards in batch pressing node. after the files have been initiated, gnest ions -say be 
odit=1, added, or deleted with the use of FOBTBAH prograas . written for that P«fP°se. Data on 
students *ho are to use the CHI package are loaded intc a .records file which aay also be 
changed with the use of the proper prograa, all in batch aode. , i 

By orograaaing the batch-oriented coaputer to act as a CAI systea, once the «iapl« sign- 
on procedure has oeen aastered, the activities of the coaputer and its. control are 
transparent to the student. Students are presented the quiz co.posed of - unigue «9« enc « of 
t>?t i+eas on a teletype, respond by typing their answers, and receive feedback as to, their 
^rforsonle! Da^a I! 'collected V student • and . by test-ite. an l; j.tli J at « 
retrieval. This orograa aay be set by the instructor to be available to students "hours a 
day or only during pre-specif ied tiaes. The instructor aay .override th'j coaputer in 
soecifying pissing or failure of a specific guiz. The instructor aay access the "nageaent 
prograa to obtain infornation of students signing on during. the day, including "««. be F' 
and inforaa'tion of individual and all student progress during the quarter, ktr the «* •< t»« 
course a data analysis prograa presents inforaation .necessary for "»i«io» of test Jtsss by 
the instructor, a coaprehensiva schedule of progress for each student, and- an oaerall 
orogrVss report. kpproxiaately 170 students haye gone fhrough this prcgrao during the -fall 
and winter guarters of the 1972-73 year. 

Suaaary Of. Results 

The aethod of individualized instruction described above was evaluated at all stages in 
teres of the percent of students coapleting all course objectives, the rate at which students 
progressed through the course, and the students' evaluations of the course. In general, the 
r=sul*s were coaparable throughout the three phases of developaent in Psychology 311 as well 
as in the technique's extension to Introductory Psychology with W0 students/quarter. During 
,ach quarter in which the aethod was used in Psychology 311, 80-90* of all students "stared 
all ten course units and earned a grade of "A". In contrast, during the five q««ters 
preceling the introduction of the individualized instruction in which a traditional l ec * oce - 
quiz aathoa was used (four different instructors), only 22* of the students earned a grade of 
"A". In ali phases, the students' evaluations of the course were very favorable. For 
exaaple. in response to the questions "By general reaction to the course was negative, 
indiff»r»nt or positive" and "After taking this course, I would like to take other courses 
using this technique", 93* of the responses were positive to the first question and 89% were 
positive to the second. 

Fiqure 3 plots a distribution of the- nuaber of students coapleting each «nit as a 
function of successive class periods during the Winter quarter, 1970. The gradual shift in 
the distribution during the first half of the quarter and tho abrupt shift flaring the latter 
half 9t the quarter is typical of tho results obtained daring all phases of developsont. 

Figure a plots the nuaber of class sessions necessary for each student to cosplote 10 
units during he four acadeaic gaartere, 1t70. Those results doaonstrate that when gives the 
opportunity to proceed through • course at their own rates, students to so. 
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Finally, Figure 5 'plots the distribution of .ean ne.fcer of atte.pts/unit for each «iit 
during the winter quarter? 19?0. Throughout all phases of development, the seen nd.b.r of 
atte.pts/unit decreased over successive units. 



Conclusion 



In attempts to- personalize instruction for the Psychology 311 course, the computer has 
proven to II "very useful in*tru.ent for individualizing pacing and testirg- f^cedures at 
proven to De a **-T fc ¥Um v.^f.r «»- „ 0 t absolutely necessary, it facilitated 




transportable since it is written in FORTH** If, readily available on .o.t "fhines, and 
requires only those adaptations demanded by the idiosyncratic titers of the sichin? to be 



squires 
used. 



Though the . course is presently, relatively expensive <S10-S30/student/guarter for 3 -6 
a'teapts on each of 10 units presented on. teletype terminals), it can be seen that- computers 
a laxiiize personal interaction by relieving the instructor fro. evaluation ™J 
allowing hi. tike to interact with individuals or s.all groups.. As bettor cosputer 
is developed, even this portion of instruction «ay be taken over .oro by siMlating tkm hu.an 
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